DOC0nn BBSWB 



Id us aoov 

iOTBOB ' 



ZB 007 0«7 



I. Coap«cativ« AaalrsiT^^sjltt'thods fdr Tactical Data 
jnpattii^, JCechaioal Pap«y 32 7 . 



TGh mst. for tlia B^bavlocal ana soc^X 



ZBSfXSOTZjOl 



FN 



Seiaacas, Arlington, , T|U • ' ; ' 

PUB -DA SB ^. .-.-Sap ^e ./J^.^-^'- '* ^'^ ' . 

BQSr ' j ' 3iip.i ««saarch sponaored by, tha^'AxafvCoabinad irns 
- Coabat'' Davalopient A^tirttyV Port Laavanworth^ 



BDBS PBICS 
DBSCBZPTOBS 



|BSTBACI 



--flprio.^ HC-$2-06 Pins posta^a. .^;v * ' ; 
JLnalysis of ?ari«nra^ *0>Bparativ€ jual^si^s; - 
CoaparatiT« ^at.istics; Conpntar Oriantad ^rq^raa^j 

, *Data Baisas; *Blactronicuj>«ta 'Proq«8»ing»'.«|n|>at > 
'Oatpat^ Analysia^'^Bav Qadhiaa stena^ ♦tathods • 
Besearcht Ul^t'arr Organi^a'tions o , " ' 



Pour di^f fa«awt'''k*tJi'ods for^i-npivt1d.«g .aneiii* aitnatio^ . 
data — (1)" 'typingi (2) typing »lt1i tfrrpr corr)ectit>n,-v|3)..>4iaoii« * . 
(choosing apfJropriato antry f ro«;^, listj / and -tiRping H^^; 
aatocoaplati'on and an, JJ^giawh, ofiiatQn-ratfra coaliarad. f or spaad^K^ ^ , 
accaracy, and aase of uaa.' Thirty- tap rfnldstad nan an^ wpaan^ no^^erof« 
vhoa had asad the inputting tifrohniflas being s:tad.led, vera rahdQBlx^ 
aasigaad to fha foar Bath<»d gjrotips. 'The -s^bject^ acta d .as -. ; 
intalliganca^ sTta^Ef antaring iAf«riatioii^ about the^beay into, a ■ 
eoaputerized data base.- Subjects reeeived Jrae ^%fact sessages / ' 
describing 'enaay actions, ectracted necessary infozBa'tiony^^and. 
entered tK^ appropriate ^des^to a ;rariation.of^the.lBne»y.l^it|iatioa 
Data Idd (BSOA) foraat of the.TOS^ystei- He«ats Indica-ted that ' 
aanos were sore error* free than the other .inputting^ aathbdsr^also* 
■enas aare popular ^aong^he <sqbject& and<'didj;*iiot.-ha»e Jiigher' aean 
tsfeaas than tie other inpttt'tiiw'^Beth6ds.,;^o ■a3ciaiz\tli9 benefits of 
the senasr specieil attention :s^ould b^ given to the designN>f an 
operational nenu-based inputting »yfeteB,-«paxticularly aith reap^t to^ 
length, display speed, and iten selection. Spelling correctors^vor 
aatoconplet ion should .be considered only for experienced aseze and in 
operational settings -that specif icallyregaire such aids. (QW?) , ,^ 
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♦ Be*prod notions supplied by BDES are the best that can be «ade . * - 

♦ froa the original dpCQBeixt. 
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^ thm Battl^f ictld Information ^sterns Techr^lcal Area of the Any Rft* ' 
rMasch Institute (ARt) Is concernejd with tl;ie Vlemaods of tncveaaingly 
(^cooiE^lex battlefield systems" that are used to' acaulre, transtnit^ proceaSf 
disaeminate, and utilize information. This increased, complexity places 
'greater demands ixpon ihe operator interacting 'with the machine system. 
Research in this area is focused on human performance, problems related 
tb Interactions within^comnand and control (Centers as well as on issue?' 
of systems development* SugH research Ijb concerned with software ^ttevel-- 
opment, toix>graphic products and ^>rocedJreSr tact^icml^ symbplogy, t^ser- 
oriented systems, information mana9iemen€, statff operations and proqedurks^ 
diecisiph support, and sensor systems"^iat^ratioh and utilization. 

' An issue of special concern within the area of user-o*i^lented' systems 
• ib the improvement of manual data input procedures, especially in the ^ 
Tactical Operations System (TOS) * The main source of infomiation for 
tactical data systems is manual data entry — a slow, err6r-prone process. . 
The cai>ai?ility of tactical ••data systems such as TOS to support cdUQand 
staff actions with accurate, con^lete, and timely i^ormation is depen- 
dent on^ the p^fonufnce of the person who must mainually enter Infozmatlon 
into the system* Previous ARI research on data entry ^s resulted in 

^ simplified message formats, improved reference ^dbides^ and aids for/ on- 
line preparatiori and verificati6n of message entr'ies. Altl)ough progress 
has been made, data entry remains a major system bottleneck*: The research 
reported here compared alternative inputting methods with foxir Revels of 
system aiding and prompting ^and has produced specific design recomotenda^ 

, tions for improving the speed of data entry and error rates. 

Research in user-brie^ -systems is conducted as an in-house ef-- 
fort augmented through contracts* This report. re^iU. ted tison- an in-house 
re^arch effort responsive to requirements of Army" ProjecX^Q?63743A774 
and to special requirements of the U.S. Army. Combined Arms "CQi^>at Devel- 
ppBie.nt Activity, Fort Leavenworth, Kans. , Special requirements^ are cbnr . 
.tained^in Human Resource Need 76-162 (77-295), -Processor Aided Retrieval 
aod Storage.^ , 
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Nearly'all information in^^ctical operations systems is input manually. 
Two problems that arise when manually inputting data are (a) the i.ntroduction 
of errors in translating information into computer format- amd (b) the intjco- 
duction of a bottleneck" in total system response timet Therefore/ alternative 
itethods of input ting^^^ta for accuracy and speed should be evaluated. 
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Pour mcthodii wore oxAinined for speod and accuracy in inputting 
'tactical messagM concerning anamy activity into an Army computar for| * 
Mit* Tha infthoda %#ara (a) typing — the user types the appropriate cod^n 
into a maatfAge format; (b) typing with an error corrector-** the compute ^ 
auteoatically attempts to correct c o mmon spelling and/ o r typing arrori 



(C) manua~tha user indicates which of the legal entries is desired f^om 
^ a list I arid '(d) .typing with autocompletion and ah English option-*-the 

ufer must tyj>e only sufficient c]|>aracters to x|^iq[uely identify the itejmi 
* using either the ^appropriate code or its English definition » 

Thirty-two enlisted persons representative of the class of military 
personnel who might serve as input device Operators input ,one of four sets 
of nine messages using each inputting method. 



The use of menus was trf^» most accurate inputting method. For 
of limited* experience (1 day of inputting) r there were no differences 
speed among the inputting methods.. 



^Consideration should be given to the adoption of menus in tacticsjl 
operatibn systems with a menu override option for experienced users. 
The use of an error corrector^ autocompletion, or oan Englis)ti*^t$ption 
is probably not warranted unless oF>erational Use shows ^a specific nee4 
for such an aid. * ^ 
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h OOMFARATIVB Mu2!tSlS OP iffiTHODS FOR tXCTICAL DATA INPUTTING ' 



BRIEF 



0 R6qQi««m^'b: 



Nearly 'all information in Victitral operations systens is input • - 
manually. T*#o problams that arise when manually inputting data are 
(a) Ae introduction of errors in translating ihformation into computer 
format and (b) the introduction of a bot^eneck ill total systen response 
time. Therefore, alternative methods of Infmttlng data for accuracy and 
s^eed should be evaluatipd. . " ^ ^ 

Proceidure: • ' * . 

P^pr methods were examined for speed accuracy when Inputting tacti* 
cal messages concerning enemy activity into an Army computer format. 
The methods were (a), typing — the user types the appropriate cod^ into 
a message format; (b) typing with an error corrector —the ccopu^r auto- 
»*tically attempts to correct cotmnon spelling and/gr typing errors; (c) 
* menus --the user indicates whicli^of the legal entrlea is desired from a 
list; and (d) typing witff autocompletion and an English option — the 
user must type only sufficient characters to uniquely identify this 
item, using either the appropriate code or its Engllajy^deflnitlon* 

* , ♦»■'..' 
Thirty-two enlisted persons, representativ«^.of ^«he clafts of mili- 
tary personnel wttcT'might serve aa iQEtt^f' device operators, input one of v 
four sets of ni^ messages - using each inputting ^tho^ ^ 

Findings: - \ ^ ^ 

^ The use of menus was the most accurate Inputting method. For users 

' o^f limited experience (;*day of itiputting) , there' were 'no differences- in 
speed amoibg .the ijtipu^ting n^thods. y - ^ /• 



Otilizatiok of Findings: , - 

. V. • • «. • 

Consideration should be given to the adoption o€ menus in ^t^j^c^ical 
^op®"tion sy^tem^ with a menu override option for experienced users. 
The^b^e o€ an error correc^r^ autocompletion^ or an English option is 
probably not warr£mted,add^ss operational use- sh6ws a specific nfeedlfor 



such an 2tid. 
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A OOMPMIATXVr ANALYSIS Of t W t WOM fOR 
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ZNTROOUCTZQN 

O^tplttt th« lon9-t«t« possibility of dirsot-ssnsor to oosvutsr- 
dsts transfer, ths main sourc* of infomstion for tscticsl operations 
•ystSBW is ■snusl. data inputting. Two problsns arisa whan data ara an- 
tarad into tha <«ystan aanuallytx (a) tha introduction of arrors in tz«ns 
lating infonaation into conputar fox«at and (b) tha introduction of a 
bottlanack in total systsn rasponaa tima. 

< 

Tha O.S. Army Rasaarch Ins^tuta for tha Bahavioral and Social 
Sciancaa (ARI) has b*an sngaqad in rasaarch to isfMCova'.parfonMnca of 
data inputting at the nan-machine interface (sea Aldaraan (1976) for 
a discussion of previous research) . Earlier rasaarch sought to ish- 
prova human performance by individualised training techniques <(Gade« 
Fields, C HLderman, 1978). by computer prompting and inatructlon (Stnabr 
197S) , and by using on-line inputtinqi'with veri^cation /(Strub, 1971). 

earlier research, however, did not focus on actiial inputting 
pKoceduresr-~<.I{:^laarh how tha method of inputting affects speed and 
accuracy , four dlir^receQtmethods for entering intelligence data into 
a Tactical Operating Systtar-iTOS) format were exasdjaad. The fastest 
■ath od could be used to alleviate tha--bQttleneck at the swn^Mcliine 
interface. The problem of introduction of^exa^pr has two partst* \(a) 
tha operator must form a correct concept of the information (froai\'read> 
ing a message, hearing a telephone message, viewing a radar scope ,\ etc.) 
and (b) tha operator must input properly formatted informmtion basid on 
a o6rrect concept, in other «iords, an error could arise if the opera- 
tor misi^nderstood the information or incorrectly input tha infooematibn. 
Although it is difficult to separata tha two sources of arro^ tha \ 
method of inputting affects inputting errors rather than concept forma- 
tion errors. • » ^ 

The fxrst of the four methods chosen for testing was typing. in ' * 
fdiich the user types the appropriate codas into a message formal Typ^ 
» i: i.JS*On method of inputting and ig^^JMBd iA «at vers tf>nil oL 'S^ 
ArmK.fs developing Tactical Operations SyStcA and pre-^ioua ARI res<^ch. 

The' second inputting method was also typing, except that a c^M^ter 
automatically attempted to correct common spelling and typing errors. 
The co^uter should be able to make corrections faster than the h^aan 
user and thus speed up the rate of inputting^ 

A third inputting method used menus, in which the oser indicates 
which of the legal entries listed is daaired. A track ball moving a 
cursor ««as used to i;idicate the entry. This method is a i is—iii altar- 
native to 'typing; it reqttires less training and the user canoot .make.- 



•p#lliii9 Mrrora. Also, b#CAu«« th« u»0 of Mnu« pl*c«» * iMilXttr ooq» 
iiltlv« iMd on th# vi»«r (r^qvic'ing r^oqnitlon fwitoory r«th«r than rocali 
Mwory),^ th«r« is «l*o th# possibility th«t f^^r errors will occur. 



Tho foiurth siWhod or^npiu^^^^ osp^islly ~itnrpi4M[p^ up 

thm rats of inputtlrm* Thi» Mthod, which ussd typiff>4 ss its basa, ro- 
quired thAt ths ussr type only sneuqh chsrsctsri to Id^i^rtfy s MMbef^ 
of ths tebls of ls9«I ontrlwn for thst iti^ of ths fomst. Th|( cosiputsr 
wouid fill in th« tput of th« ^ntry^ thus saving typing tiJM. Bscsuso 
rossarch has shown that typing Enqliah is faster than typing codes* the 
ueer* of this s^thod was allowed to uss sither the coda or its English 
definition. In aithsr cass« the participant %ias to use only Xhe wini- 
siun nusJ^r of characters neede^to Identify the code or definition. 

The different operating characteristics of the four sMtiiods pro- 
vide a basis for predicting relative inputting performance. Thus« cosi- 
pared with normal typing, typing with an error corrector should result 
in fewer errors as %m11 as a time savings. Similarly, the use of menus 
should result in fewer errors and possibly a time savings. Howler, the 
fastest and siost accurate inputting jsethod shpuld be jlOtocoaiplstion. 

oejEcfrvE 

The purpose of this research was to evaluate alternative methods of. 
inputting enemy situation data for speed, accuracy, and ease of use. 



METHOD 

Subjects 

Thirty-two enlisted men and %#omen %#ere randomly assigned to four 
groups for the experiment. Participants possessed a GT score of 105 or 
alMve, vision correctable to 20/20, and' were representative ^of Oie- class 
of military personnel who might be trained to serve as input device oper- 
ators. Although 26 o( the 32 participants claimed some typing skill, and 
several had had liidted exposure to computers, none had used the inputting 
techniqiies being/evaluated^ in the experisMnt. 



^ ^ommon. For etxamples, see Loftus & 

Loftus, 1976, pp. S6-91, or BaiSdcley, 1^76, pp. ^285-286. . 
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TtM p*rt4cip«nt» metpd mn mtt^ll igerw^ ataff m ^ m b ^tm mntmrinq in* « 
foHMticm about tha anamy into a covput^ar mod data baee. Thay raceivad 
ttmm taut »f aaa9inr~9aScribinq eneiiy actiumi . An ewun^ie mj^^mm^m in" 
Pigujm X.- Thair job waa to aKtract rha nacanaary information and antar 
tha appropriata codan into variat'ion of the enaay jiEituatton Data Add 
(BSOA) fojrmat of tha TOt^ ayntM (»ap rii|ur© 

Exparlmantal Station 

Tha ^parimant wasi curK!uct>^ in ^n aro^ contaihinq a tatjla and dhaic 
for tha participant. Two trathcKic ray Vubo^tOT) dieplaya aatl on tha 
tabla# ona ahowing th^ format into which tha participant would antar 
data and tha othar contalnimi^ tha manua for tha manu-aalaction^ inputting 
method, h track ball for tht^ mc^nu-aal^K^tion method ;waa placa4^1n front 
of that CRT. A keyboard wa a placcKj in front of tha format CRT. A dic- 
tionary was available that contained tha va^id codes and their English 
definitions ^cross-indexed to t^c items in the. fonsat* An intercom was 
provided for calling the cxprrimrnter. 



Inputting ^ 



thoHa 



Pour different inputting fiethods wire investigated in thia experi-* 
ment. Each method used automatic tabbing; that is, after the completion 
of an entry, the computar automatically moved the' cursor to ^he next en* 
try item in the format. The coo^uter did not accept invalid ^^^^ 
.an entry and gave the user an error menage to that effect. ^ 



Typing * In t)vis method « the message format appaared oa the 
acreen with the curso/ placed at the first item. The users then filled 
m the appropriate codes (including blanks) for *ach item, referring to 
the dictionary of e^alid codes and their definitions as needed. The com- 
puter rejected any inpu^ ti^hat was not a legal entry and %#ould'not allow 
the uaer to continue un^il a v^lid code %ias entered. Participants could 
backspace and type ov^ their anB%#ers^ The cursor autosuitically moved 
to the next irem Xn the mrsaage format %#hen a valid entry had t^en typa^. 



< 



2 

An invalid code is one that does ^not appear in the valid code list for 
an cnJtry.* The .tenss "^valid"* and **]^al'' axe aised intcrchabgeably . A 
valid code may be incorrect if it a^^ars in the valid code list but does 
not correctly describe the information in .the free text message. 
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Figrurc 2. Format for entering data. 
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.1 It • Typing vith Error Ctorrection > Th^a method %ias 't±ie same ais^ 
Metli^ I except that an aid -had been added~a' typing error corrector- 
Mban the oser typed an invalid^ entry, the system assumed that a typing >^ 
exzot l&ad been made and attempted "to correct the error. The tyjJing 
«zxor c or rector dealt with four Icinds of errors: transposition of two 
adjacent, lettei^, insezrtion of an extrk letter^ deletion of one letter, 
or scOtetiitUtion of one incorrect letter^ Whien the t^)ed item waus an ^ 
invalid entxyV the 'typing corrector tried^ to f osnn ia hypothesis of^^rtiaA^ 
the entry should be- . For each of the four kiiids o£ errdts, "the^typing » 
corrector foUhd% list of all the members of the valid list that wer0 
either, the sanee length as the invalid entry, on^ chauraetea: shorter, or 
one character longer, depending pn which of £he four types of typing*' i 
errors %fas beihg tesjied. Then it went through one of four processes: • ^ 

!• The typ'ing corrector scanned the target' word 2tnd the jBijtry 'from 
the l^ft for mismatches. At' the first mismatch it transposed the xnis-;^ 
matched letter in the entry with the letter to/ the right 1 If th^ n6w 
Jsepxi matqhed the t^^arget word, the t^urget'wbrd /was the hypothesis. If v 
there was no match, the typing corrSector went Ion to the next target word, 

. • . V ^ ^ / ■ . * 

.2>^ The typing corrector scsumed the target" word &id the entry ^rpm 
the left for mismatehe^'r-^ ^It deleted the mismatched letter ii^ the entry- 



and checked for a match. If there was no mat:dh, the typi^ogi corrector 
went on "to the next target word. ■ - 

" •■ r. _ \ \ ' - 

' 3. The typing corrector scetnned f rem the left for au-smatches and ^ 
deleted the mismatched letter from the tetrget word and dhecked for a ^ 
match. If there was no match, it went on, to the next target word. 

4: The typing cor/tector- scanned from. the left foS: mismatches.; At 
the ifirst mismatch, it skipped the mismatched letters in Ippth wprds^and 
dheok^ the ^rest f or a match. If there was no match, the' typing correc;^ 
tor went -on to the next target wprdl . 

TSie first hypotheses -formed when the typing corrector -found a match 
printed out on the screei. with an error message. If it was the^ -entry 
the user ^^actually wanted, the. user hit a key to signal accep^tancej^ther- 
wise the user cduld hit a key to; signa^l a retj^ing of the eritryjsY* ^^ 
typing corrector* ^cbuld not form a hypothesis, an error message^i^appearea 
on the screen and the user hf^d ^ to , retype the entry. . ^) 

III^ ><enus . In this input method, typing %ras used for entering 
three types of items* in the message format: ntap cobrdinates, dates,, and' 
cardinal nximbers . All other data *had to 'be entered py selecting the ap- 
propriate item from an alphabeticadly or logically ordered, menu; data 
could not be typed in. The message, format appeared on the righ£ CRT ^with 
a 'cursor ^t the first item. The menu of legsLL entries for the' first item 
appeared on the left CRT in their uncoded form (i.e., English defixiitions 
from the dictionary) . If a blank was a valid entry, it was included in 
the menu. When an item was chosen, its code* was filled into the message 



format by the computer and the cursor moved to -the next item.^ If an, item 
had to be typed rajther than chosen, f rem a menu (e.g., map coordinate 
strdLngK instructions to type the item would be, displayed where the menu 
' %iould normally appeatr.^ In these cases, iirvalid entries (is.g., insuffi- 
cient characters in the coordinate stringk were rejected and the next 
. item cox^Ld not be entered until a valid enti^ l^ad been nr/ped. in, as in 
. Method I. / * " " * . 

*IV. Typing with Autocoinpletion and English Option > This method 
was the same as Method. I, but Jwith two additions. First, the partici- 
pant could enter the English'^aefinition -from the dictionary in place of 
the code, as desired. Seconp, when the participant felt that enough 
chaora^ters had been typed |fe idetJitify a member of the valid- entry list 
(either code^ or English) , he wou'ld push the send button, causing the 
autocompletion program to take over. If indeed the program coixldy' match — 
the characters' witli\ the beginning of one, and only one, member of the 
valid entry list; it would automatically^ finish the entry for thfe parti-; 
cipant and move the cursor to the next entry. If a unique ma tea could 
not be^ made, the pro-am asked .fbr more characters . The partic^pamt 
could invoke the autocompletion program at any time and as oftj^ as 
' wished until a unigi)e match was. made. ^ / 

Dependent Variaflbles - , . ^ ^ , 

: / The primary dependent yaricU:>les were format completion time and 
* accxiracy in> terms of number of errors per format. Typing ^errors as well 
as errors of interpretation and" errors ^iipec if ic to a particular inputting 
,.v/^method w^re included in evaluating the number of errors per format. 

■ ' • ^ ■ • ' • 

ptiifer data collecte4 'includ^fed this, ntdstoer Qf times the typing correc- 
tor wBis used, the number of times the .ty^ corrector correctly identi- 
f ie<^ the target code, the number of times autoc^pletion was used, the 
number -oi times English definitions were used in place of codes, the 

. nimiber of times the -participant corrected, an entry by backspaqckng and 
typing over before entering the item^ and the participant's stated ' 

--preferences among the input methods.^ All the participants ' entries 
and th%- entry times were recorded as. well. ' •> 

/ • • . ^ PROCEDURE 

■ ^ ' * ' ' ' ."'"^ ' 
* ^ 4 .Thirty-3ix free text messages describing 'enemy actions were divided 
, into "four siets of nine messages with each message set <M) balanced for - 

ty^s of ^irubjects, sources, restrictions, unit identifications, and 
^diffiwa^ty during the pilot testing. For each message set, the first 
< message was always a practice message, and the other eight messages 
made up 'the experimental set.' In addition to these 36 messages, 2 other 
messages were initially presented as practice messages. 



EKLC 



dependent:. 
Only major 



- RESULTS 
* . ' ■ " . • * '* , ' '■ . ' * 

Analysis of V^ariance summary tables and means for the 
Variables in this eacperiment can be found in t^e appendix 
' findings are given here^ 

* ■» • • . * * * • ■ 

1 Accoracy ' 

Accnracy of an inputting method may be considered froo two perspec 
tives: (a) mean errors per message and (b) the number ot Farticipants 
*Ao had the fewst errors^using a particular method. For both measures 
the rank order of inputting methods was the same (see Tabl3^2) . 




Table 2 



Accuracy Ranking^ Inputting Methods 



Method 



Mean number of 
errors per message 



Participanlis who made 
the f ewes t ' errors 
using this i method 



Menus 



Typing with error 
corrector 

Typing 

Typing with 

autoccmpletion 




2.64 

3.36 
3.77 

4139 



17 



3.5* 



. 3 



Includes one tie between typing and typing with error corrector. 



. Ah analysis of variance of the mean- error data indicates tiat" the- 
^differences among the inputting methods are significant (F =» 13.98, 
df = 3,84, p < .001) . There were no statistically sianificant residual 
xnteractxons between inputting methods and message setXsessions / or 
groups. The analysis of variance table {Tabie A-1) and aaiscassion 
of other significant findings is provided in Lthe appendix. 



^ The laean tine per message using each of; the four inputting el^^itKxis 

ixuabex of participants who had their fasjftest scores^^ing^ a -cr^ren ' 
injputting oiethbd are shorn in Tabl# 3. . < ^ ^ ^ 



Table. 3 

Time Ranking of Inpijit^t^g Methods 



Mettiod 



Mean time per 
Inessage Tin* seCO] 




number .of participants who 
averaged the f aistest time 

rroing^^-tttta-method^-^ — 



Typipq with * 
autocomple^ion 

Typing wi^' error 
correct 



Typing 



:ti>r. 

T 



Menus 



413. 



397.01 



39^-05 
396.52 



13 

* 9 
7 
3 



Although scoring by mmiber of participants (%*o averaged their best 
times over the eight messages usdLng a given inputting method) is consis- 
tent /with the original predictions (see the discussion of inputting methodsi 
in the Introduction) the mean time ranking is almost the' exact "reverse. 
An analysis of varisuvce "^performed on both 'the raw time scores and the 
lc$gs of the time sc^ores (used because of skew in the time scores) showed 
that the differences among inputting methods in mean times were statis- 
tically insignificant. (The analysis of vluri^ce summary tables can be 
found in Tables A-^ and A-3f of the appendix.) The most significant factor 
in the analysis of variance of the time data was Sessions. The more p3:;ac- 
tice a participant had, the shorter the inputting time became (p < .0011 . 
Ais can be seen iif^ the mean times across 'all inputting methods for each 
session # shown in T2Q3le 4. ^ 
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'Table 4 <,-'■. • 



Time Data for Sessions ' * 



Session . Mean tiifie' (in seconds) 



1 < j 531.11 

-2 387.12 

3 360-21 

re -1 

/■ . ■ i 
• 4 ; 324.27 



■J 



...... ^ • /^i.^ . ^ ...... - 

Preferences ^ • I ■ 

■ •■-'•i' . « , - . . 

^-^'the participants were debriefed, they were ^o^^i^^about: \heir* 
p^f erences aapng inputting aethodd. It nias hypothesized that 'people - 
i#ould prefer a method with which they had perfozmed well^^either in 
'making the fewest errors or ±n averaging the fastest time. The prefer*^ 
enc^ results can be seei^ in Tat>les 5 and .6. .A coefficient of agreement 
/^(k) and an appr6xijnation of the standard error (OK) were determined for 
.ea^ tabj.e. (See Cohen, 1960, for a discussionjof ic.) Oontaw^ to ex- 
pectations , there is chance agreement or , at l>e8;t# a ' s^ght negative 
agreement between preference ai^ best performaxioe* .^For fewest errors, 

K « -.108 and oic = .149. For fastest time,' K « -.128 and oic « .057. 

* . , - « . 

Use of Compatiex Aids - . 

: * ■ - . * 

■ . ■ . A 

Backspacing > Whenever a" participant wets typing an ^try, the back- 
spacixig option was available. This option allowed the subject to back up 
Md type over an amswer to change it* The use of the backspace option 
allowed^^the participant to catch and corrie^ mistakes l^ore the computer 



the coefficient of agreement, is a measure of the agreement between 
two variables measui^ed by nomiiial scales {in this caise, best performance 
£tn^ preference) . >Liibs the Pearson pz;oduct-moment correlation coefficient", 
r,i ic can take on (values only between*-! 2md +1. A score of +1 %iould 
injdicate totals agjreement between performance and preference, and a score 
Of -1 would indicate that users never preferred the inputtdLng method they 
did be$t on. A Iscore of 0 would indicate no predictive linear relation-- 
ship between pre]fe»;ence and perf ormauice - . 



Table 5 

Agreenent Table Between Preferences and 
Fewest Errors, by inputting Method 



r 









Preference 


■ 4' 






Typing 


Error corrector Menus 


AutocGoqpletion 


Total 


Typing 


0 • " 


0 


' ■ ' 2 




0 


2 
















. corrector 


2 


0 


5 




1 ' ' 


8 




1 


3 


10 ■ 




3 - ." 


17 


AtttodoU^letion 


1 ^ 


Q 


1 




0 


2 . 


Total 


4 


a 


1& 


1 • 


4 

• 


29* 



Three siibjects did not express preferences. 



Table 6 



Agreeoient Table Between Preferences euad 
best Time, by Inputting Method 



Best time 



Preference 



Typing Error corrector Menus Autoconipletion Total 



Typing 

Error 

corrector 



Menus 
Autocootpletibn 3 
•Total 4 




1 

2 
0 
3 



5 

: 0 

6 

'16 



2 
1 
1 
4 



9 
3 

-12 
29^ 



Tttree stibjects did not 
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ress preferences* 

■ 12 i5 



wodld catch them. ^This opti^y was* frequei^tly used by/the par^cdpant^,- ^ 
asjsboim in TabW^?* llie^bacl^pacizig^op^on. could be- xi^ed with tjhre^ 
results: (a) a correct entry ^ (b)* jj^Valid (corx.ectly spelled) entry 
tbA^ was not the. correct entry for the message, or (c) an xxrvalid entry. 

' Error Corrector-. • Table 8 shc^ws the use of the error .corrector*^ 
rtie' error corrector coulcp. change ait invalid entry to a valid aDd cor- • 
rect'enltry, and could change an invalid entry to a vatlid and correct- 
entry but the partifcipant could reject that correct answer. In about 
a third of the cases the error corrector could not arrive at a valid 
•entry. * 



Autocompletion. with English Option . Table 9 shows the use made* of 
the autocoopletion option and the English option . There were six forms 
the^e options could take. The siibject could use the fioll English defini- 
*tion, and that definition could be either correct or incorrect, ^e . . 
subject could use autocompletion on either the code or the English defi- 
nition and these autocompleted entries could be either correct or 
incorrect. - 1^^ 



DISCUSSION 

Menus 



Menus appear to be more error-free than the. otter inputting methods - 
examined (see Table 2) . inde^/ there is a 40% decrease in error «with 
menoS~Jram~"the w^ Menus are P9pu- 

,lar; 18 out of 29 paurticipants expressed a preference for them.. Finally^ 
mentis do not have higher mean times than the other inputting inieth<3ds . V 
Therefore it would seem reasonable /to sttggest tHat the use of menus be 
serious^ considered for etdoption for use in tacitical data inputting.* 

This study considered menur jg.el\|Ction with a track bal^. However > 
the track ball method of menu selection does not seem to be a good method 
of inputting. It. is slow and ^.^umber some to use. There are several other 
methods of a menu selection (e.g>>^ightpep, touch-sensitive psuiels, a 
typed index code^r letter) that shobi^ be considered. Each method has 
advantages amd disadvantages; the result of this research do not suggest 
%rtiich one would be the best for the tactical data inputting task. 

None "of the menus ia tips research was particul/irly long. Most fit 
on one screen (i.e.; they w|re less thaaf'Sd^tems long) . ' The longer 
me^us (e.g., "subject") werl^divided infco sections (e.g., •"personnel," 

vehicle, " etc.) . . The firstVcreen shoSm to/ the pkrticipemt was a ^.ist 
o^ Actions from which the suBject could\ select ,a screen-sized menu. 
Even with th^ relatively fast speed of th^seiroerimental displays and 
the relative4.yr short length of the menus, participants still had to • 
wait for a*mehu to be printerf^-out so that they, could' respond. With 
slower equipment, longer menus ^ . or. more experienced^ users, delays due 



1 



1^ 7 



\ 



Oie'df .Backspacing' 



of tiM Siaber of ' 
vVMtfof'.tins bacbpacing ' . . ti^ back- 
'/badc^icing itts Average used to* correct .jtwertge ^ing wis 
^ Qfed'to'oorreQt per gelling of per - tiied on* in-' 
entry \ subject incorrect entry subject valid entry 



lOfplogvith 
v '^cxdc oocsictoc 



antocoipletioo 
^Total 



204 

105 

165 
733 



6.38 

8.09 
3.28 

5.16 
22.91 



15 

12 
5 

51 



.469 

.375 
.156 

.594 
1.59 



60. 

40 

■ 17 ■ 

* 

45 
162 



mber of tiMS^ v ; 

tirar oometor . Av^. 

1JM correctly - per * 

ao^Qted subject 



J. 



ttaber of tiMi ' 

eiror corrector . Averacfe' 

MS iocoijbctl; • {ler 

rejected \ siiject 



Aiber«etiiei • 

errdr oirector ■ • ;Jlvtrage s ' 
'oodi^ Qgi -arrive , per A 
at an entry - . subject ] 





3.25; ' ■ 


. 10 ■ 0.31 ■ 


T 

.37 . 2.59 




> 


" , • ; Table? V ; . / . 


» .* 


f 

4 




AutdboipletioD and Englisl^ Of>tion' 




i 

1 




• 





.Correct U2ie Incorrect Oor?»ct ' ' &)doi;zect -Corxect ' 'laoorzkr^ 
of full ' use of -atitocQipietioQ astoodi9lftio& antoccupletlbn oo^pletioo of 
Eoglisb , fall Engli^ jof pode /6f coie' ' ' -of English .fiigllsh 



fteqaacy 46 
.per 

subject : ' 1.44 



15 



♦47 



1,809 



56.53 



135 



14 



2.38 



4.22 



.44 



On the average, each sobject bad lOS opportonities to aie these options. 



22' 



23 




or vmitJhog u&tll tbm mmmx i%i prlntod 
defect. Therefore, eijtber a jeesm override 
emlletfle for mfpmrlmaemd^ iHers.r or careful 
loaia. M 9^^reti to the deaion of an opera^looal Mm 
poiBta i9t» a^couh tl Oth^rviatf a poorly deaigned 

ttm beaeflta found in tfiia teaear^. . . 

. V -. :/■;••• 




J . 




data frw this e3q>eri»ent suggest tha;^Jbhe participanta 
a plateaa where practice ef facta no longer a^fdcMd per 
If wxk^ * plWteaa had been/reached> perhape tiae dif 
iaputting^ grDUpa wAld have 





■doOd antocoBC^letion, for^exanple, have been faat^ if the aub^ecta 
had had aore esqierience? It is inposaible to say. Jtattocoa^etion \mm 
the ftetest inputting siethod for 40% of the participants, or 13 people. 



Jka a priori estiiHite assofting no differences SBong .inputting 
would lead ua to expect each inputting method to be* fastest for 25% of 
tlM perticipants. The seen tijw of thbae 13 piipple, 308«23 aeooc 

than any other grov^, and their use of the autucu s pl e' 
Lon lias higher than the total group average. This lesn inputting 
\^mM also faster ti^ui the average for any of tbm fdur sessions* He- 
call that the analysis bf* variance on sessions p ro fr iced the aoat signifi- 
cant results, indicating a training effect (the fastest s es sion ^«as the 
laikt one, the fourth,' and the mean was 324.27) . 



Msay subjects ccsqplained that autocosipletion was confusing and dif- 
ficult to understand. This confusion aay have^ led to the high error 
aeore and wide variance seen in the autocooqpletion data. It would 
that autoooapletion is a useftil tool only for a sophisticated 



Brr o r Corrector 

The coBputer spelling error corrector was ispressive to watch in 
actioiS; it caaie \xp with correct hyx)otheses in most cases (i.e., a hypoth- 
esis acceptable to the user) and decreased errors by 11% frosi ^pix>g 
without the e;rror corrector. Yet the practical value (less than .5' 
fewer mistakes per message) does 'not seem valuable* The error correc- 
tor should probably be considered only if. opNsrational use of a tactical 
ii^iutting system^ shows a disturbingly large number of typing and spelling 
errors. 



i optioB to OM English was not as^po|iol«r as option to osa 
.^tthla 9)^ tba English option was lutod aost^oftan.wbara tiia 
Baglish daf in^tion^wara aost ^isslailar. Zn iopatting tbm ^ 
odss (H^iloatiaf # Priority, I • I^tpadiata^' aad -IS - 
riashX fcp axafpl«# F viUi.aitti:^oi4;>latioo vas.^tw^liMd ra^iar thaa-Z. 
Tliia Qffpopalarity may M bacaiuM •tba' Efiglish raqpii^ aioy adr^ dharac- 
^jtar^to ba typad^ on tfM avaragav than tha code and al:to raqdixfd morm* 
cha g aet a r s to oniqoaly idantify the itaa.'* KnissoqlUb optioii is^probsb&y 
not iPvry oaiafal, 'pairticularly.wi.th waU'-da»ignad^.iia^T«riatttuad cod^s. 




br osa 'in iiqpottina taptical data 
vi^OQt 



ara n 

to cause fa«iar inpotting errors vi^ont not ic eabl y affect"-** 
ing iapot rate than the^other Mthods ey—lnerl in this. ree s srch > koir- 
ever, to the benefits of thf Mnos, ^>ecial at t en t io n should 

be giiren to the design of an operational n a«hj6 as ed inpotting 'sys t si- ' - 
particolarly the length of menus, the ^peed with which tiSey can be dis- 
played, and the naaner in i^iich itans are selected froai a 



' Spelling correctors or autoconplatiop ahould be considered only 
tor ei^erienced users axtd in operational settings tbmt qpecif ically 
reqoisre such aids. i 
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APPENDIX 



rSTATISTICAL SUMMAICf TABLBS 

■'>''• ^ * • 

Tabl» A-1 oontalna the lutalysia of varianctt suanary tabla for * 
tha atxor 4ji^tai Tabla a<-4 'eontalna tha naana aad arror ^tm fo^ aaeh of 
tlM- four vairiablaa and for aacb call. 

■*.'.• 

• « * 

Table h^2 contains a summary of tXkm analysis fit variance for time 
d^ifta% Several outliers were found in the data- (e.g., seme* subjects had 
never us#d Si typewriter keyboard b«fore azid Xitei^ally had ^ to '^unt and 
'pedt" foe eath key) • ' Because the presence of outliers can uxiduly;, in-« 
fipemce an analysis of variance, a second analysis of var^moe Wa run 
using logs of the time score* - The results of the se9ond aiialysis lure 
suapiii*i isil in Table Table Ar-J^ contains the means and time data 

for each of the four variables and for each cell. 



DISCUSSION 



Message sets (N) are a significant source of variance as can be 
seea^in TiJ^es ^*X^ and Groups (G) and sessional. (S) are almo 

«ihat different. Hoi#ever, since the residual (or interaction) term is 
not significant and since , the experimental design is. a 6reco«*Latin 
square with %d.thin->subject measures, tSese factors do not af f ec^ the 
mfdn conclusion concerniiig inputting methods. 



use of the log transform to reduce the skew in the time data re-* 
dbced the size of the residual term (Tables and A-3) . However, the 
ordering of the other terms remained approximately the same. In both 
ana;Lyses, inputting methods (I) are npt significant and sessiqaa' (S) are 
vary* significant (p < .001) « ' 



A mistake in numbering two "messages put a shoirt message, from set '4 
itoto s«t 3 and a lohg message from Ibt 3 into set 4* Therefore^ sww age 
^ert 3 is abouts eight items too ^short and message set 4 is ei^^t itsms 
tbb long. This prcdwbly accounts, for the difference in sieans b^tweeb 
(see TSrf>le A-5) . ^ 



Tabl« A-1 



auaalysls of Varlaac* Tabl« fot Error J>ata (32 subj«ct«) 

> • • ■ V - , . • 

■ ■■ ■ . • . r . . U 

■I" . " ' ' ' • I . , ' , 

Sourco 



of variation 




ss 




MS 

^ •- 


P 




m 






•31 




k 






XX4. 


38^ 




'm ill 








2B1 . 


51 


28 


10:05 












96 




• 


ilMMga Mta (M) 




34. 


2.0 


3 


11.40 


9.34*** 




(I) 


.51. 


18 


■ 3-^ 


17.06-. 


13.98*** 


»MSi«M (S) 




X3. 


09 


3. 


4.36 


3.57* 






X, 


76 


3 


0.59 


- 0 .48 


.afei)»j«cts/gxoups - 




102. 


09 


84 

J ■ ' ' ■ ■* 










598. 


21 • 


127 







♦**p < .OOX. 





Table A-2 








Analytiis of Variance Tabl^ for Time Data 


(32 Subjects) 




Source 
of variation , 


A 

SS 


df ( 


MS 


4 




• * 






— ^ — 


Batmen subjects 




31. 


' ft 




Groups (G) 

Subjects/groups - e. 


314557.95 
6035&8.31 


3 
28 


104852.65 
21556.01 


4.86** 


Within subjects 




96 


ft 

k 

* 




Message sets^ (M) 

l^aputting methods (I) 

Sessions 

Residual 

Subjects/groups - e^ 


87759.42 
6631.30 
. 789543.52 
41975.21 
200969.96 


3 

. 3 
3 
3 

84 • 


29253.14 
2210.43 
263181.17 

13991 ."74 
2392.74 


12. 23*** 
.92 
109.92*** 
5; 85** 


Total 


2045025.66 


127 






**p<.01. 











Table A-3 

Analysis of Vsriancs Table for Logs of time 04 ta (32 Subj4pts) 



Scarce 
of variation 



SS 



df 



MS 



Between jsubjects 

(G) 

Subjedts/graips ■ 

Within iubjects 

Nesaage sets (N) 

moutting methods (I) 
Isions (S) 
tidual 
>abjects/groups - 

Total 



* p < .05. ' 
♦♦'♦p < .001. 



313915.66 
694914.81 



64248.09 
1440.03 
781955.53 

23799;95 
179741.9 

2060015.97 



31 






.3 


' 104638.55 


4. 22* 


28 


24818.39 




96 






3 


21416.03 


10.01*** 


3 


480.101 


.22 


3 


260651.84 


121.81*** 


3 


7933.32 


3.71* 


84 


2139.8 




127 
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Nuni and Error Oiu f6r roor Virlablii ind f orUoh Cill 



m (6) 1 



2,2 



3,3 



4,4 



. 2 

} 


3 




4 


i ' 

i - 4.03 


X-4.64 


X 


-6.46 


2,3 




i 


4,2 


X ■ 2.95 


X ■ 3.01 


X 


■1.75 

3,1 




4,3 




1 X ■ 2.79 


X • 3.59 


X 


- 2.85 


I 

' 4,1. 


1,2 . 




M 


X- 2.68 


X*2.$4 


X; 


■3.24 


2,2 


2,1 






X • 3.11 


X^ 3.47 


X« 


• 3.58 



4 . , Mm tin Inputting BH^ Nun NMUoi Nt Nnn 



3.77 



Minui 



2.64 



X.3f41 



Typing vith auto- 
ooq^liiion 4.39 



ii^ift^ 



1 3.13 



ror corrector 3«36 2 4.16 



3 2.95 



3.93 



Nhe first rmb^ is^'the inplft^ing Mtbod (I) : 1 • typing, k ■ typing with error corrector, 
3 « menus, and ^- typing with antoco^letion. The second ^uaber is' the letsage set (M). 




Nun ud Tin Diti (1ft iNOfidi^ tvtt 



jifitiiblit 



Mi fdf 1Mb Oill 



T 



tin 



MtM MU 



Nt NMD 



X - S47.24 X " 379.31 X ■ 407.45 X • 326.(1 X ^^17 Ifftif 369.05 
.1 



1,1 



3,4 



4«2 



X • 493.8 X > 347.3 X > .m.lS X ■ 300«0& X f 36a.(» ^tfjiat vlth tt- 

nroMxictoe 397.01 

. 2,2 .1,4 4,J 3,1 



1 400.7) 



2 405.24 



10 



X i 410.01 X - 353.31 X ■/331.94 X ■ 312.6 ' 2- 351.97 mm 

3,3 . 4,1 Lyu ■ hi 



396.52 3 361.55 




X> 673.4 ^ ■ 468.56;X > 4ft2.31 1 - 357.74 i'> C5J0 Typlof «ith 

^ ' I NtocoiplitiOQ 413.13 

4,4 2,2 2,1 U 

X-4.01 it«J.U X-M7 x*3.5a 



i354l» 



^fintnuiibtf isthelnpQttiagiithod (I): 1\ 
3 ■ Mfloi, and 4 « typing vitb antoooiplitioo. Ihi 




1 2 * typlog vltli ttroi oozztctor, 
onbir U tbiiAtfagt let (M). 



33 
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